Stochastic Perron's method for Hamilton-Jacobi-Bellman equations
نویسندگان
چکیده
We show that the value function of a stochastic control problem is the unique solution of the associated Hamilton-Jacobi-Bellman (HJB) equation, completely avoiding the proof of the so-called dynamic programming principle (DPP). Using Stochastic Perron's method we construct a super-solution lying below the value function and a sub-solution dominating it. A comparison argument easily closes the proof. The program has the precise meaning of verification for viscosity-solutions, obtaining the DPP as a conclusion. It also immediately follows that the weak and strong formulations of the stochastic control problem have the same value. Using this method we also capture the possible face-lifting phenomenon in a straightforward manner. This is a joint work with Mihai Sirbu.
منابع مشابه
Stochastic Perron's Method for the Probability of Lifetime Ruin Problem Under Transaction Costs
We apply stochastic Perron’s method to a singular control problem where an individual targets at a given consumption rate, invests in a risky financial market in which trading is subject to proportional transaction costs, and seeks to minimize her probability of lifetime ruin. Without relying on the dynamic programming principle (DPP), we characterize the value function as the unique viscosity ...
متن کاملSolvability of Forward-Backward SDEs and the Nodal Set of Hamilton-Jacobi-Bellman Equations
Abstract. In this paper, the solvability of a class of forward-backward stochastic di erential equations (SDEs for short) over an arbitrarily prescribed time duration is studied. We design a stochastic relaxed control problem, with both drift and di usion all being controlled, so that the solvability problem is converted to a problem of nding the nodal set of the viscosity solution to a certain...
متن کاملCombined Fixed Point and Policy Iteration for Hamilton-Jacobi-Bellman Equations in Finance
Implicit methods for Hamilton–Jacobi–Bellman (HJB) partial differential equations give rise to highly nonlinear discretized algebraic equations. The classic policy iteration approach may not be efficient in many circumstances. In this article, we derive sufficient conditions to ensure convergence of a combined fixed point policy iteration scheme for the solution of discretized equations. Numeri...
متن کاملMinimizing the Probability of Lifetime Ruin Under Ambiguity Aversion
We determine the optimal robust investment strategy of an individual who targets at a given rate of consumption and seeks to minimize the probability of lifetime ruin when she does not have perfect confidence in the drift of the risky asset. Using stochastic control, we characterize the value function as the unique classical solution of an associated Hamilton-Jacobi-Bellman (HJB) equation, obta...
متن کاملLinear-exponential-quadratic Gaussian Control for Stochastic Partial Differential Equations
In this paper a control problem for a controlled linear stochastic equation in a Hilbert space and an exponential quadratic cost functional of the state and the control is formulated and solved. The stochastic equation can model a variety of stochastic partial differential equations with the control restricted to the boundary or to discrete points in the domain. The solution method does not req...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- SIAM J. Control and Optimization
دوره 51 شماره
صفحات -
تاریخ انتشار 2013